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A. system of computer assisted design for t ^ 

|onal materials (CADI) vould increase the productivity of 
il^nal designers of softvare, atid keep costs from escalating 
as rapidly as they are at p^resent. At Ha yli^ State University, some 
steps tovard CADI have been taken, vith the result that personnel 
time has been reduced for some activities, and the product improved 
in others^ A PLATO lesson that vas designed involved^the use of a 
'questionnaire employing a 2* level sort — one bj^ the courses the 
respondent had taken, and one by the design and development functions 
performed by ;che respondent. This simplified data gathering and 
improved the quality of the data collected. CADI also uses online 
documentation and interaction vhere appropriate. Hhile the system can 
be used for preparing text materials, the greatest potential is 
•^probably for lesson development. The instructional Quality Inventory 
developed by David Merrill ^ro,vides a set of guidelines that may be 
useful in designing such lessoixs. The evaluation of CADI materials, 
tfhile not completely precise, csln be accomplished by reviewing tbeir 
accuracy and conformity to accepted practice, but only the test of a 
prototype vill tell if the instructional package works. (BK) 
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INTRODUCTION 




The purpose of this presejitat ion is to descr i"be a "mUc.honeede<3^^^^^^^;^S^^^ 
of Computer Assisted Design for Instructiori^l matesr-ials. • 
for, such a system can^be identif ied> alori^' with spme^^.Q^^^ 
of the desired system. ' ,^Along the , way , it will be usef ;Ul:Itjo._de^,cr^^^^^^^ 
somev pieces of such a system that already exist and af^ , in:v fegu^^ 
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At Other .points, it will; be. useful to look at; computer a idea '^^^ 
and; computer aided manu^ctur ing/ collectively ' Krrowh^v^^^^^ 
some insights into problems that we may wish . tov^a^ 

system for computer assisied design ;of instruct ion,. \ . '^^ V >.;v- 



In desgribing a system of computer assiste^d cfesign o^^f^^ 
which, we will call CADI, - we^'will^-U5'e term 
systematic instructional design mpd^l^ thatv:many^ 6l ybii ..^■■'U^^ 
steps in such a. model- include ./Analysis,; I)esi'gji.>v D.evelopmen 
Implementation / and Evaluat ion . For purposes of thiV" ; p 
we wi 1 r a ssume some f ami 1 ia r i ty ^ w i th rthe^>^^'^^,c^^^^^^ a nd pr ocedur e s ol \ 

this c6minpn, /model'./- ,' ■ \.'y// ;^^;::''''^^''.:.»^'/ ^'^^^.V''^"'^ ■ . 

By calling" the system ^ CADI , or .^Qjiipu^ bf 

Instruction, ^ we^ are taking some It^^erti^ .model ; \' J t 'wiil<^ 

be apparenV\tha£^We. are, discussing computed usefui.;: f or ' 
anaphases of thie^ef^orty^pot jijst desig^^^^ 



Wei will^<: .also assume - faipiliar ity / Wit:h;.;t^ 

char acteiristlcs of dif f erehtjkinds^^pf lessons /:a of 
jthe system.' Where it become s..;/neq;(^ss;axy^^ ;descr^j^ 

^n other computer systems , we^w:i|L:ir more 
detail r^ecau^e we cannot assuih|2r^;^mili^^ 



Asjv.agtie as these assumptions : are , v we* stop 
^us whenever,' you feel more explanat iqn^^^ 



NEED FOR CADI 



While tfte cost of jrbmputer; hard^^ 

that is unparalleiired in othet^ intitiistr ies:^ r^-the cgst; - computer 
software and courseware conj:i^nuesA tb^^r xse . : :;i:S' not at all unusual 
for software costs to run at -five to t^^^^ hardware^ 
costs' for any given .application, and';the^gap::;C^ to widen. V \ .\ 

The ma^or reasons for. the high: cost 

cours(5ware, are rising* costs djv peirsonnelr^ in 
product i V i ty of t^ose who ■ de s ign and : deye 1 bp Jso f t wa r e . : . The s li g,l^t 
increases in productivity have come- 'as ia^ 'r^^^^ 
useful for instruction,, such \as PLM . ^ . 

■Major improvements productivity are :unl ikely- urv|?l^^^ steps 

are taken* to automate port ipns ^or all of the^^^^^^^ \and:^^^^^^ 
process, to reduce the number of persbn-rh^ 

courseware Jto- completipn . Or, if the same numti^r bf persbn'-hours^<:, 
can produce better^ courseware, that would v ^l.so \ be^ 
productivity ga^in. . - . ' : 
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The;;use^^.a^^^ intP^^^^^^^^tivity has ample precedent in 

other ' v^fehjfj^ ^^^^P^^^^^^m^^ cameta lenses used tO; be 

: somet^i^gfd^ few '^^^^cers; mosV of^ them German, 

prodUC;ed vm until a few years 

^agoy. .^;rh<^ the c^^^^y to determine appropriate 
tradedf f^-^:^^ : design well iti Advance of the prototype stage . 

The'^:lavi7S^^^^^^^ the multitude of variables in 

lens.,..(d^^ usefulj^ss of calculations . done by 
mechanitalXdesk:: c 



The -ih^^^^^ computer l-lw' design drastically changed the 

processV;- vr^^^^ possible " for . relatively unsophisticated 

companies tp^^^^ p^^ very innovat ive optics by the use of computer 

models.. These models systemat idally manipulated variables, sjich as 
curvature^ : .placement; movement, type of glass and coatings, to 
produce very complex lenses, whose characteristics were known before 
the prototype was ever built. The res^>t^--Was been smaller, lighter 
lenses> of improved quality, at co^mpetitive prices. 

There are some enormous difficulties with moving this very 
successful model to the design and development of instructional 
materials. But before we get bogged down j^n these problems, we need 
to look at some of the tentative steps that have been taken toward 
CADI, the computer assisted design of instruction. 

TENTATIVE STEPS TOWARD CADI . 

At Wayne State, we have taken a few small steps toward CADI. I^n 
s;ome cases we" have reduced personnel time required for certain 
Activities. In other cases, we have improved the product. Both are 
productivity gains. \. 

In the Analysis phase, we have des^igned and used a PLATO lesson that 
simplifies, data gatherings and improves the data th^it we are able to 
^get. We used an on-line ' questionnaire that would be quite 
impossible to duplicate using pencil an^ paper, instruments. 

You have all seen questionnaires that /had questiorts that were used 
to sort out responses to later cguest ions . They read like this: 
"Have you completed the course titled Instructional Design? If your 
answer is ho> please skip .to"^quest ion 21. If yes, please go on." 

That kind of; question, is acc6ptable/in mo'st questionnaires. But in 
our instrument', which was used to gauge the usefulness of the CREATE 
curriculum' to practicing irffetructibnal d^elopers, we could not sort* 
by: one or two' questions of this t:ype . Our need was \o sort by both 
the courses a' respondent had taken in^ CREATE, and by the desigji and 
developmeat functions performed by, the respondent, so that people 
only answered questions about / which they had had professional" 
expervenqe.. An example may clear this up: 
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Suppose a nesiDphden had jcompJeted^ the' 

■ Fundamentals: c0Upse:f the'^^^ ' o course f /and the^ two 'Author 

1 Language^: courses, In . the respondent's Job, he or she was 

■ r but did no' pirogramming. 

; S /npe -ii/e of these w i th exper ience{ related 

V to the ct^ respondentwoi^l d then get questions 

- ' ^ abcxji ^: 'i:h^s^^^ course and . the Des Vgn course, but not 

' the Author * : • * / 

This Vtwo--level • not possible j^ih : a paperrand-pencll 

quest i:onna;iTB'.V.\':f;'^ -'V''- \ - ^ .S 

Another .characte^^^ of t^is lesson s'iSt it^ apart, from the usual 

que^st lonnaiire^ ^/ T^^^ were Li k,ert-sc<ale item!, in which the 

respondent" moyed^^^^^;^^ along a^ line from ' strongly disagree ' to 

' str'^ongly agreie 'r 1^^^^^^ choice . If ithe response" was at an 

extreme for- yi^o^ lesson proippted the respondent 

to w^rite a 9-hort note, . mu like that 'whibli; occurs when some kinds 
'of ' errbrs occtir/i lessons^' The note was automatically titled with 
the ^ question: numbex,-^^^ we.- cbuld determine' ""what it j was the * 

re*spondent:;w^s 'v/r iti about . v' ' , ' • * i 

This.^ .use oX/t^^ comma^nd allowed us .to selectively usje open-, 

ended resppnsey^^ where ithey* w,ere likely to gather useful 

irif .6rma^t;ion , rather thar;i in a scatter-shot ^rianner..- 

We .used .a.'multiple 'sigtion, which was;* .given -^to members of ' the sample.,^ 
so .that anonymity could, be pr^'served.- ^ 

■ V' ■ r . ' - ■■■■ V ■ V ^ :^ 

As in most . of o.ur. 'efforts r this, one/c^qui-'red. the expertise of 
several ppopl^ to, make it work'. T ;^designed the insfcrumient j and ..the 
lo^gic of the lesson. .;- Steve/' Stricklanqt^.^of CDC - in Southf ield 
Michigan, wrote the individual, questions, Sndi'Paul Jung programlnerf 
^ the , lesson. Many people /.at' ,CDC'§ courseware group rev|iewed the 
instrument and mac^e valuableV'stig^esLt ions for improvement, i , 

We -wili be demc).n5tra^i.ng''the lesson and spmlg .-of the products we. have 
produced at the Resource. Center on Sa-turday ." - ! 

In the De^ign^.phase , we . ntake ^ heavy use 6f on-J.i.ne cplocumentation ,and 
interaction. '"Oiar yrs^e of --text f lies ndte 'files, and cJpcumentor 
files is not of particu^lar note, since many '"development groups .do 
the same ^thing§.^ \^ report them here , thbugh3,^nust toj point .out- 
that these common/activiti:fes could be part, of a CAnJvo^ystem. 

In addition to the f acil it^ies. „ provided I on; PLATO for generation, 
storage, and retrieval ,of documentation, we -us^p' similar facilities 
on Wayne Stateyuhiversity's Computers . For ^some efforts',- j the use^ o^ 
other systems^s far more useful than use 6 iE' PLATO, stmplyf^. becaus.e 
. . of access.' Wayne State^Vs ./mainframe facilities: are^ apcessfble f ronr 
- ; ^'\huhdreds of standard ASCII terminals scatteredf' 'atound the Detroit 
>: •^metropolitan ar|ea.' If , our subject iria'tter lexperts xir 'cojrisultants 
-f^^^^^ it easier to access the university sj^s-tem, / >e ^w.ill .{^ use ^ the 
f>o>.erful. ediors of -^that- sfysteifi^ f or ! p:re.paration o''f design documents, 
content • narratives and ' the lik^* '1 ! ^ ^> i / \ ' • » 

ERIC . -v: ■ ^' ■ ' . ' \ 



Comjxjten '-Ass isi^ Des\gh- of Instruct iony '.. > 



;Prepkration of text materials is / alpbst '/• always condqct^cl on the 
university system • rather than ^on^ PLATO, ' since • the p,utput of that 
..system can, be/ in the form of camera-ready^., justif ied ; text, with a 
variety of type faces and sizea*^, produced on a Xerox laser printer 
foc^;a few cents a page;- That system provides a dramat ic.Aimprovement 
in productivity. The beauty of 'the ' system is that the' 'text never 
hits paper until it, is ready ..for the priniter. The /designers 
subject matter experts, :and consultants have worke,d the /textv over 
on-line, without the need' for laborious re-typing at each/ stage. - 



^If the final product is likely" to be a PLM course , 'we may use PLM as 
a design* and development tool. Many of you ha vis .used ^^PL^ as a 
delivery, and mnag^me.nt tool for: instruction. But we recogni'zed that 
a design document for a curriculum includes much of 'the same /text as 
will"^ eventually be entered into PLM. 'The duplicated ' information 
comes in tfee part* of the document that d[eSbC:r,ibes the /individual 
; ' learning activities , tests , and the like , at ^the level of .individual 
. lessons. - ' 

• Objectives, learning resource descriptions, 'and the like, should not 
be retyped several times. -We • will enter fc^em into modules and 
instructional uni/^s early in the development stage, along With test 
itejns that may have been developed as we worked through objectives, ^; 
so that they are'/ready for, us when we get: to the lesson development 
stage. Prints of/ the* modules are useful as /dfesign documents', and . 
some clients review them on PLATO so we do not prepare -separate 
documentation .for that portion of the effort. x 

The use of /automated data gathering from lessoi^ and "PLM is we^ll- 
documented; in many places, and presumably is. familiar to many of 
you, so we; will not discuss it further here. We don't "do anythingc^; 
: too startling in; this area , but , like doc^umentation ^ we. mention it 
to note/ that this evaluation^ tool shouldfbe .considered as part of a 
CADI system. V ' , - . <r; . ^ , ^ 

I think we ought to step, back f or ,a minute and look again at CAD/CAM 
for some insights int^o w^at we are doinig. 

^In Computet / Aide^ Design and Manu£a(2turing, the^ individua.J. pieties 
that/ will design ai ^part^^ and th'eri control the manufacture, of the part 

^are/well ir^ . plac'e -^ando^ accepted. . The nex.t step is to 

integrate / the'- processes^./ tp reduce the manual steps needed to make 
the whole thing ;work as ^ system. The Department of Defense, has in* ' 
fact begun "'development of ' an integrated "fcompiate^r aided .manufacturing 

* package,, called ICAM,"^ tliat^ in 'effect; .ties together all the . 
disparate pieces of CAD/CAM, to' reduce -the ^manual "interface that ; 

^typically exists between various phases of design and manufacturing. 

' • ■■■■ ■ , . »• . ' •. . • •■ . . . ■ 

;;^That .Step^ ag^in, provides us with some direction ia the design of a 
/.CADI system.:* For a 'vaf iety^of reasons, the pieces that exist don''t 
V . work together . We can produce design documents that include prints 
of PLM modifies , : bu|- the{ pieces aren't compatible." So if . we want a 
single documlfent/ w'e^'i rid pp typing parts :0f it twice*: once into^ ' PLM . 
: and once again into "the design document.^ Content descriptions 'that j! 

• could /^well serve as introductions to CAI. leasohs or 'text readings ' 
■ V ma:^;v haye to be retyped to bring them into the system where ^the. text [ 

ERIC ■ ..X ; e. •. : ; . 
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• be uJp.ed.. 



will 

But the -greatest, 'potential for CADI is probably legson 
development. In the. instructional' development field, we are getting, 
close to "the pJoir?^ at ^4iich we can specify one o£ a finite set of 
ij«st£U£ti procedures, once .we have classified the - le^arning 

outcomFT^ttat^ is de^red. ' ' . * ^ ' 

The - Instructional Quality Inventory/ or IQI , developed by David 
Merrill under Navy sponsorship, provides a set of guidelines that 
^may be useful in computer aided -lesson design . The model * requires^ 
^that a designer classify learning outcomes according -to a specific 
pcheme. Once that step is completed, the IQI specifies ir\ 
QS)nsi.derable ^detail , the exact steps a student should complete in 
order to master the object ive . In conversatioa, Merrill has claimed 
remarkable success for the scheme, . \^ 



If th^ claims ape justified, the rriodel provides a powe^rful tool for 
use in a CADI system. ^ . * ^ ' ' : 

PROBLEMS ' ^ X 

Let's .return again to CAD/CAM to see., >^ere we ^re. In 
manufacturing^ once you have designed a** jbart ,f or .an assembly, it is 
possiMe to make a pretty' fair ;judgement about the ability of the 
part ^^^^ meet the - specif ications . ^ To^ illustrate the point ,: let ' s, 

'look aga.iX. at the .lens design problem. If a computer model is used 
to designs . a lens, the model can ialso be used to -measure 

'characteristics of the lens, to a high. order of accuracy, before, the 
lens is bui^t. The laws " of optics are, well . known. The major 
difficulty is being certain that a lens can be built that matches 
the design. That is to say, ^the design of the lens can be evaluated 
using only the computer model, and most experts would agree on the 
results of the evaluation. ^ . ; ( 

I'm. afraid that, evaluation at the desighv sta'^ge of in_struct io'n Is not 
nearly- as precise a -science. A problem in the analogy begins to 
appear. We don't knc^w the' laws of ^j^arning as well as we know the 
laws of opticsl" We cannot evaluate^an instructional design with the 
same sori: of certainty that is applicable in manuf ac-tur i^ig . 

We do review the design for conformity to accepted practice, and for 
accuracy. But we have to - &uild the prototype, and try it out, 
befbre we kno.w what . happens .when students use , an instruct ioinal 
package. ^ » / 

- .* ' '' ' . ' - , 

We need to do a lot more research into learning,'^ to extend the 
usefulness of the . instructional routines used in the^/*iQ,I. At Wayne 
< State, we have several dissertations in progr%ss . now that are 
looking at instruct ional design^ variables . • I am .certain si*iilar 
studies , aire going on elsewhere. Tennyson at the University of 
Minnesota and Merrill at' USC are working on ' these and related 
problems. > ^ ^ ^ _ . 

The results of sucjii work will be that increasing portions of lesson 
^development can be ^automated, which will improve productivity and 
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malce our products Increasingly useful and attractive^ 



